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Abstract. We give a risk-averse solution to the probleni of es- 
timating the rehabihty of a paraUel-series system. We adopt a 
beta-binomial model for components reliabilities, and assume that 
the total sample size for the experience is fixed. The allocation 
at subsystems or components level may be random. Based on the 
sampling schemes for parallel and series systems separately, we 
propose a hybrid sequential scheme for the parallel-series system. 
Asymptotic optimality of the Bayes risk associated with quadratic 
loss is proved with the help of martingale convergence properties. 



1. Introduction 

A common approach in formulating the problem of reliability estima- 
tion relies in a multi-objective optimization problem, i.e., maximizing 
the reliability estimate and minimizing the associated variance or risk. 
For a system with risk-averse designers or users, the second objective 
is a major consideration. Because testing resources and budgets are 
often limited for the design, a real difficulty lies in determining optimal 
sampling schemes for testing components [3], such that the associated 
variance or risk of the system reliability estimate can be lowered by 
allocation. The problem reduces, therefore, to optimal allocation rules 
which can be solved using dynamic programming techniques and which 
are costly in practice. Henceforth, and typically for large samples, as- 
ymptotic optimality via sequential procedures can be used as an alter- 
native to solve the allocation problem approximately, cf., e.g., [TlH] and 
the references therein. We consider in this work the problem of estimat- 
ing the reliability of a parallel-series and/or by duality a series-parallel 
system, where the components reliabilities are independent Bernoulli 
random variables with beta priors on their parameters and which are, 
themselves, independent. We assume that the total sample size for 
the system is fixed, but the allocation sample sizes for subsystems or 
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for components may be random. The system reliability looks as mul- 
tivariate polynomial of components reliabilities. In E], sequential 
estimation of the mean of a bivariate polynomial was discussed. We 
seek for a sequential procedure which minimizes the Bayes risk subject 
to squared error loss. Reliability sequential schemes for a series system 
were given in a frequentist framework [8], and a bayesian framework 
with two components [1]. We have proposed, in [Ij, a frequentist solu- 
tion to the parallel-series systems, where subsystems sample sizes were 
fixed large at the same order. Recently, we optimize this solution by 
considering only the total sample size fixed large, and the key idea is 
to overlap the scheme for each parallel subsystem within the scheme 
for the full system at component level, cf., e.g., [2]. 

In section ([2]) we discuss the bayesian framework for a parallel sys- 
tem. The results are used in section ([3]) to construct properly the 
hybrid sequential design for the parallel-series system. The sampling 
schemes are shown to be asymptotically first order optimal. 

2. Reliability sequential scheme for a parallel system 

2.1. Preliminaries for a parallel system. Consider a system S of 
n components (1), (2), . . . , (n) connected in parallel, each one has a 
reliability Pi. Assume beta priors for the Bernoulli proportions Pi which 
are independent: 

Pi ~ f3{ai,bi) , 

where Oj and bi are some positive and known parameters. The system 
reliability p is 

n 
i=l 

Since a Bayesian framework is considered, then an estimator of p, sub- 
ject to quadratic loss, is assumed to be 

n 
i=l 

where Pi is the posterior mean of the Bernoulli proportion pi under 
beta prior, for i = 1, ...,n. The posterior distribution of Pi is given by 
P {aim,,bim,) with parameters: 

rrii 

aim, = ai + ^xf\ (2.1) 

k=l 

rrii 

him, = bi + mi-^xf\ (2.2) 

k=l 



where x^^"* is the binary outcome of unit {k) in component (z) and rrti 
the corresponding sample size. Denote by = + 6j, then 



p=i-n 



i=l 



n bi + irii - X. 

i=l 



(fc) 



2.2. Asymptotics for the Bayes risk. Let m = X]r=i'^« total 
sample and let J-^ the ex-Field generated by where Xj = 

{X^^\ ...,xj;'^'^). Since the are independent random variables, the 
posterior expected loss of p can be written as follows: 



/ (mi, ...,m„) 



n E [(1 - p,)^ / - n [(1 - /j-^] 

i=l j=l 
n 

1=1 

J-JL \ L mi + / 

1=1 ^ ' 



E 



Pi i^-Pi) n (1 - Pi) Z-^" 



i=l 

+ F 



^1 



rrii + Ti 

An 



Till + ri 



m„ + r„ 



where are some random variables bounded by 1 and F is an 
algebraic sum of products of at least two of its arguments. Hence, for 
large m, the Bayes risk is 



R,n{p) = E 



E 

i=l 



u,. 



rrii + Ti 



i=l 



1 

rrii 



(2.3) 



where Ui = E \Vi/J^rr] and Vi = pi{l- Pi) H-^- (1 - pjf. It should be 
pointed that, for all i in {1, ...,n}, Ui = Uim is a sequence of random 
variables (the index m will be omitted later to simplify the notations) 
depending on the allocation numbers mi, ...,m„ as follows: 



Ui, 



(^imfiimi 



n 



{rrii + ri) {rrii + ri + I) {rrij + rj) {rrij + rj + 1) 



(2.4) 



where airm and birm are given by expressions (12. ip and (12. 2p . 
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So, the Bayes risk can be approximated, for large samples, by 



Rmip) = E 



E 

.1=1 



rrii + Ti 



It should be pointed that rrii is treated as a random variable while the 
total sample size m is assumed to be fixed. Then, the approximated 
Bayes risk can be rewritten, thanks to Lagrange's identity, as follows: 



E 



Rm{p) 



\^ /TT.\ -uV^ ( {ruj +ri ) y^- (m j +r-j ) VUl) ' 



i=l 



=1 j=i+l 



(2.5) 



2.3. Two-stage sequential design for the peirallel system. Fol- 
lowing the results of the previous section, sequential procedures can 

be developed for the minimization of the Bayes risk when the sample 
size m is fixed. Since + and mj are of the same order for large 
samples, then one can choose such that 



for all i, J in {1, which gives the conditions 

^/U^ 

rrii — m— 



for all i in {1, n}. 

Assume m fixed, then the allocation numbers mi, ...,mn are deter- 
mined by the following sequential procedure in two stages as follows. 
Denote by [x] the integer of x. 

Stage one: Sample L = [^/rrl\ units from each component i and 
evaluate the predictor 



rrii 



m- 



iL 



for all i in {1, . . . , n}, where 



nn 



ajL (ajL + 1) 



(L + n) {L + ri + 1) I A + rj) (L + rj + 1) 



(2.6) 



Stage two: Sample m — nL units of which mi — L are units from 
component i and where is the corrector defined by 



rrir. 



max {L, [rhi\] : i 



n — 1 



n-l 

E 

j=i 



2.4. Asymptotic optimality. Asymptotics of the Bayes risk incurred 
by the two-stage scheme are based on the following lemma which is itself 
a consequence of the sampling procedure. 

Lemma 2.1. The integer rrii given by the two- stage scheme satisfies, 
for all i in {1, ... , n}, 



lim — 

m^+oo m 



a.s. 



Proof. Since L = [\/rn\, then as m — )■ +oo, ^ — )■ 0. It follows that for 
large m, 



mi 



m- 



iL 



Moreover, as m — )■ +oo, L ^ oo, and 



a.s., 



E^f^ Ev^ 

i=i i=i 

since, for alH in {1, . . . ,n}, Vi is integrable and f/j^ = [l^/Ai^] with 

= a{x[^\. . . , X[^\ ...,X^n\..., Xi^^). The proof follows directly 
by the properties of the integer part at infinity. □ 

Theorem 2.1. Let Rm{p) the Bayes risk incurred by the two-stage 
scheme, then 

2~ 



lim mRm{p) = E 



m—^+oo 



i=l 



Proof. A first consequence of lemma (12. ip is 

lim mRmip) = lim mRmip), 



(2.7) 



where Rm{p) is the asymptotic Bayes risk given by the expression (12. 5p . 
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Hence, the proof follows if one shows that 



lim E 



.i=l 



E 




and 



lim E 



{{rrii + Ti) ^JTT^ - {rrij + rj) y/V])' 
(rrii + n) (rrii + r,) 



0. 



(2.8) 



(2.9) 



Since Ui = E [Vi/J-'m] and Vi G L^, the martingale Ui is uniformly 
integrable and consequently, as m — )• +oo, Ui ^ Vi in and al- 
most surely, for all i in {1, ...,n}. Martingales properties yield \/Ui — )■ 
y/Vi in L^, and the first identity (12. 8p follows. 

For the second equahty (12. 9p . lemma (12. ip implies that 

v2 



{{rrii + r-i) ^JTTj - {rrij + r^) a/UI)' 



{rrii + Ti) {rrij + rj) 

converges to zero in probability, as m — )■ +oo, for all i,j in {1, ...,n}. 
Hence, it will be sufficient to show that this sequence is uniformly 
integrable. This may be true if it is bounded by an integrable random 
variable. So, 

, 2 



{{rrii + Vi) ^/U] - {mj + Tj) y/Ui) ^rrii + Vi^^ ^ ^j+^j 



{rrii + Ti) {rrij + Vj 
rrii + ri 



rrij + rj 



rrii + Ti 



m 



Since, for large m, 



then 



Ui < — Ui + TiUi. 
rrij + r j rrij 



m 



rrii 



< 



i=l 



-<max(^gv^^ 

Applying Doob's inequality to the right hand side of this last inequahty, 
one shows that this term is integrable since, for all j in {1, n}, Uj is 
bounded. 

Similarly, one can do the same with the term 

mj + rj 



rrii + Ti 



-u. 



and the identity (12.91) holds. 

The proof of the theorem follows from (12.70 . (12. Sp and (12. 9p . 



□ 



7 



Remark 2.1. Using the duality between the parallel and the series con- 
figurations, all the results obtained for a parallel system can be adapted 
straightforwardly to a series system. More precisely, one has just to al- 
ternate the roles between components reliabilities {pi), respectively sys- 
tem reliability (p), and probabilities of failure {qi = 1—pi), respectively 
(g = 1 — p); the Bayes risk remaining the same. 

3. Extension to a parallel-series system 

3.1. Preliminaries. We consider now a parallel-series system S of n 
subsystems Si, Sn connected in series, each subsystem Si has a relia- 
bility Pi and contains rii components Cn, Cj„. connected in parallel, 
each component Cij has a reliability Pij. 

As in section beta priors are assumed on the proportions ptj, 

Pij ~ P {a'ij,bij) , 

where aij and bij are positive and known parameters. Assuming in- 
dependence across and within populations, reliabilities estimates are 
shortly summarized as bellow. 

n 

P = Y\Pi (3-1) 

-U^^-pW] (3.2) 

i=i / 

where p^ij is the posterior mean of the Bernoulli proportion pij. The 
posterior distribution of pij is given by (3 [aijmij, hjmij^ with 




O'ijniij 



k=l,mij 

bijm,, = bij+niij- xlf, (3.4) 

k=l,Tnij 

where x^j'' is the binary outcome of unit (k) in component Cij and rriij 
the corresponding sample size. 

3.2. The Bayes risk. The integer Ylj ^ij = is the sample size 
in the subsystem 5*^, while Yli'^^i = is the total sample size in the 
system. Denote by the cr-field generated by (Xi,...,X„), where 
Xi = {Xii, ...,Xj„.) and Xij = {xlj \ ...,xlj '■'''). 

Assuming quadratic loss, typically p, pi, respectively p}j are Bayes 
estimators of system, subsystems, respectively components reliabilities. 
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The Bayes risk Rm{p) is the mean with respect to evidence of the 
posterior variance. With the help of independence, one can write 



Var [p/J-'i 



E 



E 



Ylpi/j^v 

i=l 

i=l 

n 

n N/-^" 



WpV^. 

_i=l 

= \{E[pl/Tr. 

i=l 
n 

= \[E[p1/7r, 

i=l 

Hence, the Bayes risk is given by 

n n 
Rm{p) = \{E [pJ\ - n [PJ\ - Rm. fe)) , 



Var 



Pil^n 



(3.5) 



i=l 



1=1 



where Rm^ (pi) is the Bayes risk corresponding to the subsystem Si. 

3.3. Asymptotics induced by the two-stage at component level. 

For each rrii fixed (large), if one determines the partition {rriij, j = 
1, ...,ni} according to the two-stage design defined in the previous sec- 
tion for the parallel subsystem Si, then the corresponding Bayes risk 
can be written, thanks to theorem (12.11) . as follows. 



B 

Rm, (Pi) = — + O { — 



rrii 



rrii 



(3.6) 



with Bi constant, 



B, = E 



and Vij are random variables defined similarly as in subsection (12. 2p . 
It follows that 



Rmip) 



i=l i=l ^ 

RM + f2o(—] , 



B^ 
rrii 



V "nii 



where 



Rm{p) = E 



E 

i=l 



BiWi 



rrii 



is the asymptotic Bayes risk, and Wi = E[Zi/^rn], where 

n 

z^= n Pi 

1=1 l^i 

A calculus based on posterior distributions gives 



Wi 



n 



( kj + mij - J2 a;Jf I bij + mij - J2 a^Jf + 1 



k=l 



k=l 



{aij + kj + mij) {aij + kj + mij + 1) 



bij + mij - ^ 



X 



(k) 



k=l 



y {aij + hj + mij) {aij + bij + mij + 1) 



(3.7) 



3.4. A hybrid sequential design for the parallel-series system. 

It follows from Lagrange's identity that, 



E 



Rm{p) 



i=l 



^ [mi^/BkWk - mk^/BiWi)' 

i=l k=i+l ITLimk 



m 



Hence, for m fixed, and according to this last identity, one can allocate 
sequentially the sample size mi at subsystem level such that, for all i, k 
in {1, ...,n}, the conditions 

mi a/ BkWk = mk^/BiWi 
are satisfied, or equivalently, for all i in {1, ...,«}, 

VBiWi 



mi = m- 



(3.9) 



k=l 



Remark 3.1. Following the remark ^2. ij) . the criteria ^3. 9^ is similar 
hut not identical to the rule expected for allocating mi as in a pure series 
system where each subsystem is reduced to a single component. The 
difference lies in the weighting coefficients Bi (the rates of convergence 
of the risks RmXPi)) which allow to take into account the estimation 
cost for each parallel subsystem reliability at component level. 

As a result, we propose the following hybrid two-stage scheme. Let 
L = [\/m\, respectively L = [a/L], the initial sample size for each 
subsystem Si, respectively each component Cij. 
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Stage one: Sample L units in each component of the system, 
(i) Evaluate Wi (denoted by Wi) according to the formula (13.71) 



with TTij = L and m, 



L. 



(ii) Calculate the predictor at subsystem level, 



rrii 



m- 



y/BiWi 



L j=i 

Stage two: Sample m — nL units more for which rrii — L are in 
the subsystem Si, where 



rrii 



rrir, 



max {L, -fhi} : i = 1, . . . , n — 1, 

n-l 

m — nii, 

i=l 



and calculate the sample size rriij at component level, according 
to the second stage of the sequential scheme defined in subsec- 
tion (O, i.e.. 



max < L, 



m 



k=l 



ikL 



■ j = l,...,ni 



rrii, 



rrii 



n.i-l 



m. 



where U^-i are evaluated properly by the relation fl2.6p . 

3.5. First order optimality. As in the parallel case, cf. section ([2]), 
we have the following convergence result. 

Theorem 3.1. The Bayes risk Rm{p) incurred by the hybrid sequential 
design satisfies 



lim m.Rm{p) = E 

m— >+oo 



i=l 



Following the arguments used in lemma (12. ip . and the hybrid se- 
quential scheme, one can show that rrii and m^- are of the same order 
at infinity, for all i,j. The following lemma yields a similar comparison 
of m and m,-. 
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Lemma 3.1. The integer rrii = J2j=i m by the hybrid sequen- 

tial scheme satisfies, for all i in {1, . . . ,n} , 



mi 

lim — 



V BiZi 



k=l 



a.s. 



Proof. Similar to the proof of lemma f l2.ip . since the coefficients Bi 
are constant. The key point is that Wi converges almost surely to Zi 
(integrable), as m — )■ +oo, i.e., as L or L — )• +oo. □ 

Proof of theorem Ii3. As a first consequence of lemma (13. ip . 

lim m.Rm{p) = lim m.Rmip) 



lim E 

m— >+oo 
n— 1 n 



,i=l 



BiWi 



i=l k=i+l 

The proof follows if one shows that 



lim E 



{miy/BkWk - niky/BiWiY 
miirik 



lim E 



E 



and 



lim E 

m— >+oo 



i=l 

(niiy/BkWk - mk\/BiWi) 



rrtimk 



(3.10) 



(3.11) 



Similarly, as for theorem (12. ip . equality (I3.10p follows from the uniform 
integrability of the martingale Wi = E ZijTm and martingales prop- 
erties which yield a convergence in of ^Jwl to a/^, as m — > +oo. 
All the same, the second identity is a consequence of lemma (13. ip . the 
hybrid sequential scheme, and uniform integrability of the sequence in 
(13. lip which follows with the help of Doob's inequality. □ 

4. Conclusion 

The hybrid sequential scheme was constructed, based on the two- 
stage sampling scheme for each parallel subsystem at component level 
and the sampling scheme for the series structure at subsystem level. 
The first order optimality was obtained, mainly, by the martingale 
convergence properties and Doob's inequality. With minor changes, the 
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series-parallel systems may be treated similarly, using duality. Namely, 
the techniques discussed here can be tediously adapted for complex 
systems involving a multi-criteria optimization problem under a set of 
constraints such as risk, system weight, cost, performance and others. 
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